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ABSTRACT 

This report describes a survey conducted in 1979 to 
determine uner response to SCORPIO , part of the Library 'of Congress 
Information System (LOCIS) consisting of online catalogs that are 
used directly by the public and. are integrated with regular reference 
services* A questionnaire distributed to 123 users of this system 
asked about types of users, frequency of use, waiting tiiee, 
instructional methods^ information desired, access points used, and 
the computer versus the card catalog. The results showed \a overall 
positive reaction to the system. Only six percent of the users felt 
it was hard to learn, although 85 percent wanted more training and 
documentation. Host users learned from librarians or printed 
flip^charts: for futur^e improvements, online or computer-assisted 
instruction was preferred over audiovisual or group instruction. 
Three-quarters of all users performed subject searches, a finding 
that contrasts with other catalog use studies. A list of nine 
references and a copy of the questionnaire including the raw data are 
provided. (Author/FM) 
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As library catalogs have grown and changed, new forms of catalogs are 
beting tested and evaluated. COM, online, and computer-produced book catalogs 
are affecting library use and servicesr, and we need to find the best ways to 
integrate these catalogs into the reference environment and to identify the 
users' reactions to them. The Library of Congress has an online catalog which 
is used directly by the public throughout the reading rooms and which provides 
full author, title, and subject access to the MARC file and to selected in-house 
data bases. This article describes a preliminary study which was made of SCORPIO, 
a segment of the developing Library of Congress Information System (LOCIS) and 
which may contribute to the understanding and development of online catalogs- 

The SCORPIO system 

The beginnings of the SCORPIO system (Subject-Content Oriented Retriever 
for Processing Information Online) date from the late 1960's, when the Library's 
Congressional Research Service (CRS) began developing an online information 
retrieval system furnishing legislative and bibliographic data. The Bill Digest 
file (CG series) and the Bibliographic Citation file (BIBL/CITN) were available 
online to CRS staff members by 1969. The SCORPIO system at the Library of 
Congress was an outgrowth of the "non-unique key retriever" capability which 
was developed for CRS about 1972. The structure of the SCORPIO/Logic Library 
System is technically based on work which originated in the middle 1960's at 
Lockheed under sponsorship of the National Aeronautics and Space Administration 
under the names "Dialog" and "Recon." The full SCORPIO programs, created by the 
Library's Information Systems Office (now the Automated Systems Office, ASO) , 
were in use in a few Congressional offices by 1974, with the addition of the 
National Referral Center file (N'K'JM) and CRS^s Issue Briefs (ISSU). In April, 
1975, the first computer terminal for public use was installed in the Science 
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Reading Room, providing accees to the National Referral Center file (NRCM> a 
directory of organizations) and to the Selected Science and Technology data 
ba^e: 90,000 English-language monographs in LC classes, Q, R, S, and T selected 
from the MARC tapes. Without any special announcements or training, the system 
was set up to test the software, hardware, and public acceptance. 

SCORPIO evolved, based on feedback from this successful experiment and 
from LC and Congressional staff, and in May, 1977, the Computer Catalog Center 
(CCC) was opened adjacent to the Main Reading Room. Located in the CCC were six 
Sycor CRT terminals, two with Tally local printers attached. Brief printed 
instructions were available, and a reference librarian was on duty to assist users 
with the system. There are currently a total of twelve terminals and four printers 
for public use in the Main Reading Room area, and about fifteen public terminals 
scattered throughout other reading rooms. Considerable expansion in public ter- 
minals is planned in 1981. The Library's computer systems support over 1500 
terminals for reference, processing, and administrative use (including terminals 
in Congressional offices). 

"SCORPIO" refers to a retrieval language with consistent command and 
display techniques across the different files in this portion of the LOCIS. 
Access points usually include authors or other personal names, titles, corporate 
names, subject terms, and identifying numbers such as LC card number or other 
accession number. Searchers may browse through dictionary indexes of these 
access points, and then create as many stored sets as desired. Sets may be 
operated upon with Boolean logic, or limited by various elements in thr> record 
such as language or date. Entries may be displayed in full or abbreviated for- 
mats. Patrons use the system directly, without a librarian as intermediary 
except for initial instruction or ready-reference checks. While off-line prints 
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line prints cannot be gene rated "for public users of~SCdPRIO, those users may 
print at no charge on local terminal printers. 

Library users tave free access to the following files: 1) Library of 
Congress Computerized Catalog (LCCC), allowing searches by author, title, LC 
subject heading, class number, and card number of the entire MARC monographs 
data base; 2) National Referral Center file (NRCM), serving as a directory of 
organizations which offer information resources in science, technology, and 
social science; and 3) a series of files produced by the General Accounting 
Office based on the three-volume C ongressional Sourcebook series. The public 
has limited access to certain CRS files which are in the public domain, provid- 
ing legislative and public policy information. The most heavily used file is the 
LCCC, which represents 80% of the use on public terminals, and 40!? of overall 
SCGRPIO use. As a whole, the LOCIS includes MUMS (Multiple-Use MARC System) and 
several other administrative and information retrieval subsystems. The only por- 
tions of the system involved in this study were the publicly available SCORPIO 
databases mentioned above. 

When this study was first conceived, the CCC had been in operation for 
a year and no formal evaluation had taken place. Although we were serving 40 to 
50 users who were performing about 200 searches each day, judging from cursory 
reference and automation statistics, there were many questions to be answered. 
We needed to know who our users were, what approaches they were taking to 
SCORPIO, how effective our instructional methods were, and how the online cata- 
log compared with the card catalog. We also needed to assess the adequacy of 
our hardware and software. Some specific data were available from ASO as to the 
number of transactions per day per terminal and which files were accesed , but 
some kind of user survey was necessary* to get a fuller picture of public usage. 
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Survey development 

A literature search revealed an interesting gap: between the great 
body of information on card catalog use, and on the use of online information 
retrieval services, there was no published work on direct (i.e. not via an 
intermediary) use of an online catalog. Nevertheless, the techniques of both 
types of studies were pertinent to the SCORPIO survey, A state-of-the-art 
review by Ruth Hafter (1) of catalog research appeared in late 1979, and she 
also observed the lack of information noted here. Although problems in loca- 
ting entries and understanding bibliographic data are encountered in online as 
well as card catalogs, some considerations of card catalog studies were inappli- 
cable, such as economic ones. Since there is no charge to users for SCORPIO use, 
and since all the data have been entered , there was no pressure to determine the 
minimum number of fields one would have to convert, or the most time-saving 
methods of searching the file. The common measures of precision and recall for 
information retrieval evaluation were also not immediately helpful; it was not 
possible to construct an experimental file of known items to test recall, and 
assessing the indexing precision of existing IC subject headings would be too 
large a task to undertake at this stage. User effort as a measure is relevant 
and has been indirectly incorporated into the survey. 

At the time of this initial research, some information was available 
on the online plans of various libraries (2), and since then many other reports 
have appeared, for example in the Alternative Catalog Newsletter ; there is still 
almost no user evaluation of these systems. The most applicable work was that 
done at the University of Toronto Robards Library and at the Ohio State 
University Library. In the process of closing it9 catalog, Toronto had briefly 
experimented with an online catalog and had surveyed its users before settling 
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on a final COM catalog. OSU had taken its circulation system, the Library 
Conf^ol System (LCS), and was modifying it to function as an online public 
catalog. Reports of both these projects were examined (3), and the author 
visited OSU to observe its terminal configuration and system operation. 
Particularly interesting were the preliminary results of a survey conducted 
at OSU, A questionnaire was administered to 30^^ users of the LCS over three 
acaclciimic quarters. For example, students were asked why they used terminals, 
how long they had known about the system, how they had learned to use it, 
what kind of searches they performed, and so forth. Most respondents learned 
from library staff or a printed handout, and the vast majority found it easy 
to use even though few had used any other terminal system previously. Although 
60% of the respondents preferred using LCS to the card catalog, only 32% felt 
it could replace the card catalog. The LCS was more liisited at that time than 
SCORPIO, not providing subject access, but the kinds of questions being asked 
directly paralleled much of what we wanted to know about SCORPIO. 

Scattered statistics and studies from within LC were pulled together 
to provide background for the survey. Studies of SCORPIO had been undertaken 
by CRS as part of broader evaluations of its total information service (4). 
A few articles about SCORPIO have appeared in the library literature, but 

\, 

these have concentrated on its role in providing information to the Congress 

\ 

and on technical aspects of the system design (5). Other supporting reports 

\ 

included a brief assessment of the Science Reading Room terminal experiment, 
based on user comments in a log-book and machine-generated tallies of searches 
(6); forecasts of automated catalog development at LC (7); portions of a general 
reader survey carried out in April 1976 by the Librarian's Task Force on Goals, 
Organization^ and Planning (8); proposed policy statements on public terminal use 
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from an interdepartmental commiteee convened shortly after the CCC first opened. 
These, together with an early plan for a user survey th^it had not been implemen- 
ted* all stressed the need for more detailed evaluation* 

Various statistics on SCORPIO services were available. CCC staff 
kept records of the number of questions they were asked, reflecting only staff 
interactions and not the actual number of terminal users. ASO produced machine- 
generated tallies of the total number of transactions per file, th^ number of 
commands and errors made (an average of 15 commands and .62 errors per search), 
and the average length of searches (11-15 minutes). However, one user may make 
several searches at one sitting, and ASO figures did not give information on 
how people were using SCORPIO, what they were finding and not finding, and which 
steps in the search procedure caused problems. 

The preliminary proposal for the survey was submitted with the intent 
to survey both users and non-users in all areas ^here public terminals were 
located. Since specific performance criteria did not exist for SCORPIO public 
services, or other similar online catalogs, the project would not constitute 
an evaluation in the strictest sense, but rather an informal attempt to charac- 
terize the users and determine their understanding of and problems with the 
system. This pilot study could point the way toward a more comprehensive inves- 
tigation. 

Methodology 

The development of the survey instrument and sampling methodology pre- 
sumed that this would not be a highly-controlled experimental situation, but a 
loosely-defined population being examined amidst many constraints on the survey 
process. The final questionnaire comprised 38 questions, 36 of which were some 
form of closed-end, multiple-choice question. The questionnnaire was printed as 
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printed as a twelve-page booklet, including a back page for user comments. A 
statistical consultant advised on. the questionnaire construction and s^mpling ^ 
technique. A copy of the questionnaire, indicating the responses, follows this 
paper. 

It was difficult to decide on an effective method of distribution 
because of the physical arrangement of the terminals and the ^staffing patterns 
in the reading rooms. Both the terminals and the card catalog stretch across 
three rooms with several entrances, and reference staff rotate during the day 
among four different stations. It was not possible to control many different 
areas at once or '.o canvass the rooms to identify recipients of the non-user 
survey. Consequently, although alternative methods were considered, the non- 
user portion of the survey was postponed until a full test had been made of 
the user questionnaire and survey methods. 

Since users are not required to sign in at the CCC, we did not have 
an exact count of the population; however, we did have the reference and ASO 
statistics mentioned earlier. Using these for the same month one year prior to 
the olanned test period, we estimated the number of persons who might use the 
CCC during any one day or series of days. The availability of these statistics, 
and the layout of the CCC, where users must pass the librarian's desk on their 
way to a terminal, led us to further restrict this phase of the survey to the 
six terminals in that area. We decided to sample rather than survey the entire 
population, and to distribute the questionnaire at specified but varying times 
of day for two weeks, causing as little disruption as possible to users and to 
reference staff. 

Survey implementation 

The survey test period was from May 14 through May 27, 1979, including 
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evenings and weekends. The sampling schedule broke the day (8:30 a.m. to 9:30 
p.m.) into nine periods of one or one and a half hours. Questionnaires were 
distributed every third period, changing the pattern of distribution each day. 
To determine the total population, a roster was kept at the librarian's desk 
at the CCC with pages corresponding to the sampling periods. All arriving 
users signed in on numbered lines; if they came during a survey period, they 
were handed a questionnaire coded to the roster page, implicitly representing 
the time and date. Users who first signed in during a non-survey period snd 
then either stayed through or later returned during a survey period were not 
given questionnaires; each user had only one chance to be surveyed during the 
two-week peiriod. This method placed the emphasis on the number of persons and 
not the number of machine transactions; it also did not give heavier weight to 
chose who vsiid SCORPIO more often. Although we expected concern about the 
respondents* anonymity since the questionnaire's were linked to the rosters, 

\ 

there were no complaints during the course of th^ survey. 

The final sample numbered 148, which was about 30% of the total two- 
week CCC population of 493. 123 questionnaires were returned, giving a return 
rate of 85%. Users were asked to return the form to the librarian at the CCC, 
and most tended to fill it out as they searched. Postage-free mailing labels 

vere provided for those who could not complete the questionnaire on the spot. 

'\ ^ \ > 

The roster was checked off as the surv^eys c^e in, and some telephone follow-ups 
were made to request that questionnaires be returned. 

Data analysis ^ 

As the answers were coded, errors, omissions ,\^nd misinterpretations 

were noted for future revision of the questionnaire. No questionnaires were 

\ 

totally rejected, although specific answers were occasionally invalidated. 
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Written comments were transcribed and sorted into categories. The data were 
keypunched in a fixed format, and a simple Statistical Package for the Social 
Sciences (SPSS) program was used to compute the frequencies and to cross- 
tabulate some of the questions. 

Based on the number of questionnaires returned and the percentage of 
the users represented thereby, a rough calculation was made of an overall sam- 
pling error of +^6.6%, with a confidence interval of 95%. This assumes a com- 
pletely random sample; for the "clustering" technique used iii this survey a 
complicated and precise error formula was derived and could be used in a more 
extenfiive study. The sampling error present in cross-tabulations, where a 
smaller number of cases are being examined, is much higher. There is also an " 
unknown amount of error resulting from the questionnaire content and its admin- 
istration. These considerations limit any inferences drawn from the surevey 
results. 

Results 

The survey showed that users like SCORPIO and hope it will do more 
for them in the future. Despite variances and biases of the survey, it at 
least helps us understand our public. Grouping the questions into related 
areas provides analyses of 1) general population characteristics, 2) the SCORPIO 
user environment at LC, 3) instructional effectiveness, and 4) purposes and 
comparisons of SCORPIO and card catalog usage. Percentages quoted represent the 
proportion of the total number of cases (i.e., the percent of 123), not of the 
total number of responses to any one question (which may number less than 123); 
figures do not always add to lOOZ because of non-responses or situations where 
users could pick more than one answer. 




1) Popul'ition characteristics 

One quarter of the respondents were at LC for the first time, as op- 
posed to those who use LC several times a week (21%), several times a month 
(23%), or only occasionally (30%). When asked about SCORPIO use, 43% indicated 
they had just learned to use it and 48? had been using it for one to four months 
or longer. The sample was thus roughly divided in half between new and experi- 
enced users of the computer system. From the list of possible affiliations, the 
two categories most often checked were students, either undergraduate or gradu- 
ate/professional school (20% each). The other significant grouping with three 
categories representing the general adult public: author/private researcher, 
doing professional or work-related research, and doing personal or non-work re- 
search (about 14 people each). Other users included faculty, Congressional and 
LC staff, and federal j?overnment employees. Two-thirds of the users were from 
the Washington metropolitan area. Although respondents were asked to write in 
the subject of their research, this was not coded because of the inconsistency 
of the types of answers given. 

Most users (64%) found out about SCORPIO simply by seeing it in the 
Library; 25% heard about it from a friend or colleague. Only nine people had 
been referred by a librarian at LC. A fourth of the respondents hail previously 
used other information retrieval systems. Among experienced users, eight people 
used terminals at least once a day, 12 at least once a week, and 19 at least 
once a month. About 24% used terminals infrequently or sporadically. In rela- 
tion to demand for printers, perceived by reference staff to be quite high, only 
ten people indicated that they used printers every time they used SCORPIO. 
Another 30% used printers often or sometimes; 22% had never used a printer and 
the remainder were new to the system. 
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2) SCORPIO user environment 

Indicating all the terminal locations they preferred, 22% of the 
respondents checked the CCC as the spot they usually went to for terminals. 
Thirty-four percent (the largest single group) said they used terminals where- 
ever it was convenient for their work. 

Only 11 respondents said that they had had to wait to use a terminal 
on the day of the survey; of those, nine waited less than five minutes. How- 
ever, only 20 users had never had to wait for a terminal, and 702 of those who 
were not new users had had to wait sometimes. Of those who used printers on 
the day of the survey, 65% did not have to wait. Comparable to straight term- 
inal use, about 62% of printer users had to wait sometimes, and only 16% had 
never had to wait. The question on queuing did not distinguish among different 
library locations; however, when asked where they would like to see more term- 
inals installed, 37% (a plurality) said that more were needed but that it didn't 
matter where. 

In an effort to equalize access for all users, different time limits 
for SCORPIO use were proposed on the questionnaire. While 35% of the respondents 
favored a flat 30-minute limit on terminal use, 42% favored having a five-minute 
"express" terminal and other terminals with a 30 or 45 minute limit. For print- 
erc, a 15-minute and a 30-minute limit were each preferred by about 30% of the 
users, as opposed to a limit based on the number of pages or citations printed. 
Only 5 users felt there should be no limits at all. At present there is an 
informal 30-minute limit on SCORPIO use, which may be extended if no one else is 
waiting. Some users will search different topics for an hour or longer. Time 
limits may be necessary in the future, and the users appear to support this. 
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3) Instructional effectiveness 

\ 

Several approaches to user education have coexisted at the CCC and 
in other reading rooms: one-to-one instruction, flip-charts, brief cards, and 
wall posters. In some cases special sessions are arranged for small groups, 
and audio-visual materials have also been proposed. Congressional and LC staff 
receive training separately from the public. 

Roughly half of the respondents first learned to use SCORPIO from a 
librarian at the CCC. Another 25% said they used the flip-chart beside the 
terminal, but as this chart is also used by librarians in demonstrating to 
users, a portion of that 251 could have been working with reference staff and 
not exclusively with the chart. Other sources of instruction, including friends, 
brief cards, in-house training, and non-CCC librarians, did not represent very 
large numbers of users. When asked whether it was easy or hard to learn to use 
SCORPIO, only seven people checkpd hard. Fifty-seven percent checked easy, and 
37Z felt it was neither hard nor easy. Among new or experienced users, or 
different categories of users, there was little variation in this opinion. 
Despite these encouraging answers, 85% of all respondents felt they could benefit 
from additional training or written material - 

Considering a list of factors involved in using SCORPIO, respondents 
rated each as easy, medium, or hard to learn. Deciding which command to use, and 
inserting correct spacing and punctuation caused the fewest problems, with 65 to 
68% of users rating these easy. To get the correct order and format of commands 
and to understand the printed instructions was considered easy by 50 to 55% and 
medium by 35 to 39%. Although specifying subject headings and understanding com- 
puter messages also received about a 50% easy rating, these two had noticeably 
higher hard ratings (12%) than the other factors noted above. By far the most 
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difficult factor was "figuring out what to do when problems occur"; only 17% 
rated this easy, 37% medium, and 41% hard. Gaps i . instructional materials 
and ambiguous system messages both contribute to this frustration. There is 
not atVpresent a "help" feature on SCORPIO that aids the user in going to the 
next step* 

Another question listed options that could improve instruction, with 

i 

choices of yes, no, or maybe for each. The strongest preference (64%) was for 
computer-assisted or online instruction; 61% answered yes for take-home manuals, 
and 57% felt more complete instructions and messages displayed by SCORPIO would 
have helped. The least favored option was group instruction, which 58% felt 
would not have helped; only 16 people checked yes. Users showed no marked feel- 
ing on having more assistance from library staff, and only a slightly more posi- 
tive reaction to having more detailed manuals beside the terminals (48% yes, 25% 
maybe, 20% no). The idea of slide shows or other audio-visual media was also 
received rather ambivalently. Choices in this question were not much affected 
by the way in which users had first learned, except that those who learned from 
a friend had a predictably greater desire for more help. 

Assessing the effect of physical features of SCORPIO hardware showed 
that users have very little difficulty with the Sycor terminals and Tally 
printers most commonly found in reading rooms. Among factors such as keyboard 
layout, screen brightness, character size, and printer operation, the latter was 
the only one that caused problems. The procedure for resetting the printer mar- 
gins, which must be followed every time the computer has been "down" or the ter- 
minal power turned off, is confusing. One exception to the general ease of 
operating terminals was in understanding the function of some switches and keys; 
37% of the users felt this was hard, three times as many as for any other factor. 
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Many control buttons are in fact not ever used in searching by the general pub- 
lic, but their presence may be disconcerting. 

With many automated literature searching systems, users are required 
to reserve and pay for services. Although this is not true at LC now, further 
demands on and expansions of computer services might necessitate a consideration 
of such policies. When asked whether it would help to reserve facilities, users 
were not certain: for SCORPIO instruction, 38% said no, 42% yes; for terminal 
use, 42% said no, 42% yes; for printer use, 37% said no, 45% yes; for consulting 
with a librarian who would do the search for the user, 48% no and 36% yes. Long- 
term users were more willing to reserve for instruction, but not to use terminals 
or printers, and were more strongly against hav^g staff search for them. These 
answers, together with the preferences for instructional methods, reflect a 
"hands off" attitude among the respondents, who seem to desire self-sufficiency 
and to want to avoid dependency on the library staff. 

The responses were only slightly more definite on the question of 
paying for services. Although actual fees were not quoted, users indicated a 
willingness to pay for offline prints (58% yes, 30% no) and local terminal 
printing (56% yes, 34% no). Those who used the printers most often were not 
necessarily more willing to pay. Respondents were evenly split on the ques- 
tion of paying to have librarians do searches or of purchasing instructional 
manuals, even though they want more of such manuals. Patrons who had exper- 
ienc with other information retrieval systems were more likely to accept 
pav ig a librarian to do searches, but otherwise their use patterns were not 
significantly different. One user wrote that requiring reservations could 
lead to problems with "no-shows," uneven scheduling, and discrimination against 



ERiC . !S 



- 15 - 



new and/or hurried users. Another "taxpayer" added that as many services as 
possible should be charged for on an individual basis. 

4) Access points: SCORPIO and the card catalog 

The last portion of the questionnaire inquired into purposes for and 
approaches to SCORPIO and card catalog usage. The most frequent general purpose 

fbr.using SCORPIO was "to scan the available literature," an option circled by 

N 

53% of the r^espondents . "Preparing an extensive bibliography" and "selecting 
a few good items" were each circled by about 27% of the users, who could choose 
as many options as were applicable. Other uses included checking legislative 
information or just familiarizing oneself with the system. In identifying more 
precisely the types of information sought, we found the outstanding category, 
circled by 76% of the respondents, to be "what books LC has on a particular 
subject." Even graduate students and faculty showed this high percentage of 
subject searching, which contrasts with findings from other catalog use studies 
(see table). LC's closed stacks may account for part of this, as researchers 
must do their browsing through catalogs and not proceed directly to the shelves. 
Other factors might be the novelty of SCORPIO and the expectation that a large 
research facility like LC might have items unknown to a patron. The next 
largest categories were searching by author, circled by 37%, and checking call 
numbers for specific items (33%). After the projected freezing of the card 
catalog we expect to have heavy demand for quick call-number identification, 
especially once we are fully dependent on the LOCIS and have no manual backup 
such as the planned "add-on" card catalog. 

In their most recent search on SCORPIO, 23% of the people had used 
personal names as an access point, 27% used titles, and 69% used subjects. 
Of those who used subjects, 73% browsed randomly under some word, 5% consulted 
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CROSS -TABULATION OF QUESTION 12, TYPE OF USER, BY QUESTIONS 
28 AND 29, TYPES AND PURPOSES OF SEARCHES 



Search 




28-1, extens. 
biblioR. 


12 

(48%) 


9 

37.5% 


3 

37.5% 


1 

25% 


4 

36.3% 


0 


3 

18.7% 


1 

6% 


1 

7.6% 


34 


28-2 t select 
few Items 


7 

28% 


5 

20.8% 


2 

25% 


0 


2 

18.1% 


3 
75% 


5 

31.2% 


3 

20% 


7 

53.8% 


34 


28-3, scan 
literature 


15 
60% 


15 
62.5% 


5 

62.5% 


3 

75% 


5 

45.4% 


I 

25% 


9 

56.2% 


6 
40% 


4 

30.7% 


63 


23-4, check 
facts 


6 

24% 


3 

12.5% 


0 


0 


1 

9% 


0 


1 

6% 


5 

33% 


2 

15.3% 


18 


23-3, other 


1 

4% 


2 

8.3% 


1 

12.5% 


0 


3 

27.2% 


0 


4 

25% 


1 


3 

23% 


15 


29-1, books 
by author 


10 
40X 


10 

41, 


5 

62.5% 


3 

75% 


1 

9% 


1 

2S% 


7 


4 

26.6% 


3 


44 


29-2, books 
by subject 


19 • 
76% 


21 
87.5^ 


7 

87.5% 


4 

100% 


7 

63.6% 


3 
75% 


12 

75% 


8 


10 
76,9% 


91 


29-3, pdcl. 
articles 


10 
40% 


10 

41.6 


2 

25% 


3 

75% 


1 

9% 


0 


6 

37.5% 


1 

6% 


1 

7.6% 


34 


29-4, identify 
names 


6 

24% 


7 

29.1 


2 

25% 


2 

50% 


2 

18.1% 


1 

25% 


4 
25% 


3 
20% 


2 

15.3% 


29 


29-5, books 
by title 


5 

2C% 


11 
45.8 


4 

50% 


1 

25% 


3 

27.2% 


1 

25% 


5 

31.2% 


3 
20% 


2 

15.3% 


35 


29-6, identifj 
call numbers 


10 
40% 


7 

29.1 


4 

50% 


2 

50% 


3 

27.2% 


2 
50% 


6 

37.5% 


2 

13.3% 


2 

15.3% 


38 


29-7,' legisl. 
info 


6 

24% 


6 
25% 


1 

12.5% 


3 

75% 


1 
9% 


0 


3 

18.7% 


3 
20% 


0 


23 


29-8 , names 
of orgs. 


5 

20% 


2 

8.3% 


0 


3 

75% 


1 
9% 


0 


3 

18.7% 


2 

13.3'/ 


0 


16 


' TOTAL PERSONS 
IN CATEGORY 


25 


24 


8 


4 


11 


4 


16 


15 




120 



ERIC 



(Percentages are by column, i.e., the percentage of that category of person, 
row percentages, see main questionnaire results.) 

IS 
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the LC Subject Headings list which is kept near the terminals and catalogs, and 
112 used LC classification numbers. Difficulty in making effective use of sub- 
ject headings was noted earlier as a problem. Although this is not unique to 
automated systems, it requires more attention in SCORPIO than in the card cata- 
log since subject authority records are not yet online to the public. The lack 
of a cross-reference structure may go unnoticed as users browse unused terms or 
perhaps find only title entries. 

SCORPIO displays records in card (or accession) number order, not 
alphabetically. Eighty-three percent of the users felt this was satisfactory. 
When asked to consider other sort options, there was a slight preference for 
reverse chronological order, rated as better by 31% of the respondents. 
Alphabetical order by title was rated as better by 15% and as the same by 
46%; alphabetical by author was rated as better by 22% and as the same by 43%. 
One user suggested a capability for choosing any sort order appropriate, and 
a Library committee is currently studying this possibility. 

Users who could not find what they wanted after an initial SCORPIO 
search took different steps. The two most popular alternatives of those 
listed in the question were trying a different search term on SCORPIO and 
going to the card catalog, each chosen by about half of the survey population. 
Consulting the librarian on duty at the CCC was chosen by 28%, and 25% went 
to printed indexes and bibliographies. Trying another data base was considered 
by 20% of the users. Users could check as many steps as they wanted, although 
there was no way for them to indicate the order in which these steps might be 
taken* 

Analyzing the approaches patrons take to SCORPIO and the card catalog 
is affected by the coverage of the two tools. Thirty-seven percent of the 
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respondents were looking for materials published after 1969, the approximate cut- 
off date for inclusion in the LCCC. Only 12 people were interested exclusively 
in items published before 1969 (most such users would not have been in the survey 
population), and 51% were using materials covering all dates. About half the res 
pondents had used the card catalog in addition to SCORPIO on the day of the surve 
Of those who used the cards, 62% were looking by subject, 50% by author, and 40% 
by title. One-third of the users who only need post~1969 materials used the^card 
catalog even though they were also using SCORPIO. 

The questionnaire attempted to compare the ease of certain search opera- 
tions between SCORPIO and the card catalog. Many people left the rather long 
question blank, or misunderstood it, so the data are quite unreliable. Most 
users tended to rate SCORPIO as easier than the card catalog for everything, 
even when the option given was not available on SCORPIO, such as finding cross- 
references. 

The last two questions addressed a crucial issue: whether SCORPIO could 
replace the card catalog for the user's present purposes. The respondents 
as a whole were divided 50/50, but 70% of those who had used the cards that day 
answered negatively. Surprisingly, only two-thirds of those using exclusively 
pre-1969 materials said that SCORPIO could not replace the cards. The remain- 
ing one-third may not have understood the question or the limitations of LCCC. 
As expected, those users interested in recent materials, legislative informa- 
tion, and organizational resources all supported SCORPIO as a complete 
replacement. The two reasons most often cited for not moving to SCORPIO were 
lack of periodical titles and of items cataloged before 1969, mentioned by 46% 
and 68% respectively of the users against replacing the cards. Other factors 
were the absence of various languages and formats, and the inconvenience of 
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waiting for terminals. These factors may all be resolved through hardware adJi- 
tions, intensive programming work in progress, and long-term projects such as 
the tapes under production by the Carrollton Press, which will furnish us with 
retrospective records. Difficulty in learning to use SCORPIO was the least 
important reason, cited by only seven people who did not want it to replace the 
card catalog. 

X 

5) User comments 

The last page of the questionnaire invited user comments about SCORPIO and 
LC services overall. These remarks generally fell into the areas of instructional 
problems, the scope and coverage of the files, and complimentary remarks about the 
system. There was only one outright negative assessment of LC among the entire 
survey population* 

Users asked for coverage of pre-1969 materials, and some mentioned the 
awkwardness of having to check two sources for a thorough search. Others felt 
the most useful, thing would be to allow remote access to LOCIS from other librar- 
ies, and to tie in with other national libraries in one large data base. It is 
interesting to see user support for the networking activities which have been 
pursued nationally and internationally. Other suggestions included entering 
music. New Serial Titles , National Register of Microform Masters , and similar 
cataloging/ Vocational publications. 

Users revealed problems with instruction both directly, by asking for 
more documentation, and indirectly, by complaining about difficulties that 
could have been resolved had they asked a librarian or read existing documen- 
tation. Some users felt the flip-charts were too detailed while others telt 
they were not comprehensive enough. 



\ \ 
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There were many Irief complimentary remarks. The staff were commended 
for their assistance, and people were grateful for the SCORPIO resources. One 
user wrote, "This is the best use of my tax money I have come across in 
Washington.** 

Problems and future plans 

In the description of the survey methodology, some restrictions and 
compromises were outlined. Some of these could be overcome in future studies. 
The instrument itself was lengthy, causing respondents to skip questions or 
answer hurriedly. The distribution process was ci^bersome, particularly the 
sign-in procedure. The survey was not unobtrusive, and may reflect a bias from 
a self-selected population. In expanding the survey to cover other terminal areas, 
a more efficient and less confusing technique would be needed to count the total 
population, draw a sample, and code questionnaires. In so doing, and by moving 
the survey dates closer to peak use periods, a larger sample could be drawn, the 
error reduced, and broader conclusions reached. However, such techniques might 
require greater staff time and more disruption of the user. 

The lack of non-user data leaves many questions unanswered, and these 
data must be gathered i f we are to fully understand problems with and resistance 
to LOCIS. Non-users could be identified and interviewed about their impressions 
of the computer system: are they aware of its existence and functions, what are 
some reasons they have not used it, and so forth. 

SCORPIO does not exist in a vacuum, and usage characteristics of other 
components of LOCIS should be taken into account. MUMS (Multiple-Use MARC 
System) was initially developed for technical services but further development 
of its retrieval capabilities has greatly enhanced its usefulness for reference 
purposes. Its indexes are generally more current than those of SCORPIO and 
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incorporate corrections to records. It also provides access to serials, maps, 
in-process, and name authority records, in addition to those for books. It is 
used regularly by public service staff and we are now instructing patrons in 
its use. Future surveys might examine its use patterns as opposed to SCORPIO'S, 
and may help our continuing work to integrate our systems. A recurring online 
survey might be an effective way to progressively mon-i-tor—computer-use-rrandomly 
generating screens of questions on designated terminals and automatically linking 
the user's answers with machine tallies of commands entered, file use, time of day, 
and so forth. Questions could be varied according to terminal location, study 
requirements, and systems a and the responses processed continuously, with current 
profiles available when needed. 

Conclusions 

This study was a successful first attempt at surveying SCORPIO use. 
The problems identified by patrons coincided with those observed by staff, and 
we have also been reassured on many points. Many different kinds of people 
use our computer catalog without great difficulty and they seem to have con- 
fidence in the system. Although the LOCIS is working well, we must direct 
attention to areas that can be improved, such as clarifying system messages and 
planning an online tutorial program. Priorities exist within LC for these ele- 
ments; the Committee on Automation Planning and the Advisory Group on the 
Future of LC Retrieval Systems are among the mechanisms used to analyze auto* 
mation needs and to facilitate library-wide input. 

The LOCIS is an integral part of reference services at LC for both 
Congress and the public. This survey shows the overall positive response of 
the public and has opened other avenues for inquiry. For example, we could 
examine more closely the steps in the user's search process and how it is helped 
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or hindered by the software. It would be interesting to know how much use even 
experienced patrons make of sophisticated commands^ such as limiting and combin- 
ing sets, and whether this is enough to justify theXeffort spent in developing 
these features. Controlled test populations and test^^ta bases could facilitate 
more critical comparisons between different online systems and between online and 

V 

card catalogs. Physical and pyschological aspects of terminal use, user expecta- 

\ 

tions of online systems, and other human factors considerations will become 
increasingly important as we depend more on automation. Investigation into method- 
ological improvements will benefit all of these areas.. "Use of the catalog to study 
itself," as discussed by Phyllis Richmond (9) in relation to machine-readable cata- 
logs, has great potential for public service as well as technical prov: . 5sing • As 
more libraries establish and evaluate similar online systems, information on their 
use can be synthesized to enhance planning and standards development, and to con- 
tribute to the growth of knowledge in this field. 



I wish to acknowledge the^ invaluable assistance of Daniel Melnick of the 
Congressional Research Service in the developmient of the survey methodology, and 
of Nick Schweitzer of CRS and Maurice Sanders of the Collections Management Division 
in the programming analysis. 
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This survey is designed to gather information about the users of our 
computer system (SCORPIO). By taking the time to fill it out, you will help us 
gain a clearer understanding of your needs and problems, and we will be better 
able to design services and resources to meet them. We thank you for your 
cooperation, and encourage you to add any comments on the back page. 



First, please let us know how accessible our computer services are: 

Ql. How long did you have to wait for a terminal today? (Circle the number) 

/^O 1 DID NOT HAVE TO WAIT 

' 2 LESS THAN 5 MINUTES 

' 3 5 TO 10 MINUTES 

O 4 10 TO 20 MINUTES 

' 5 MORE THAN 20 MINUTES 



Q2, How frequently do you use the terminals? (Circle the number) 

1 THIS IS MY FIRST USE 

9 2 AT LEAST ONCE A DAY 

1^ 3 AT LEAST ONCE A WEEK 

4 AT LEAST ONCE A MONTH 

5 INFREQUENTLY; ONLY A FEW TIMES EVER 



Q3. How frequently do you have to wait for a terminal? (Circle the number) 

1 THIS IS MY FIRST USE OF A TERMINAL 

2 NEVER 

3 SOMETIMES 
2^ 4 OFTEN 



Q4. How long did you have to wait to use a printer today? (Circle the number) 



7Z 
30 

H 

o 



1 DID NOT USE A PRINTER TODAY 

2 DID NOT HAVE TO WAIT 

3 LESS THAN 5 MINUTES 

4 5 TO 10 MINUTES 

5 10 TO 20 MINUTES 

6 MORE THAN 20 MINUTES 



ERIC 



2 



Q5. How frequently do you use printers? (Circle the number) 

3? 1 THIS IS MY FIRST USE 

2 NEVER (If so, please skip to question #7) 

2^ 3 SOMETIMES 

4 OFTEN 

/O 5 EVERY TIME I USE SCORPIO 



Q6. How frequently do you have to wait for a printer? (Circle the number) 

35 1 XHIS IS MY FIRST USE OF A PRINTER 

^ 2 NEVER 

30 3 SOMETIMES 

4 OFTEN 

Q7. When others are waiting to use a terminal , what limit should LC 

establish on the use by any one person? (Circle the number) 

8 1 15 MINUTES 

2 30 MINUTES 

J. 3 45 MINUTES 

^ 4 NO LIMIT 

7 5 HAVE AN "EXPRESS" TERMINAL, LIMIT 5 MINUTES; OTHERS WITH NO LIMIT 

5*2. 6 HAVE AN "EXPRESS" TERMINAL, LIMIT 5 MINUTES; OTHERS WITH 30 OR 45 

MINUTE LIMIT .\ 

5 7 OTHER: ' - 

\ 

Q8. When others are waiting to use a printer , what limit should LC- 

establish on the use by any one person? (Circle the number) 

3St 1 15 MINUTES 

35 2 30 MINUTES 

7 3 45 MINUTES 

6 4 5 PAGES OF PRINTER PAPER 

f ^ 5 10 PAGES OF PRINTER PAPER 

<o 6 NO LIMIT\ 

^ 7 OTHER: \ 



■Next, we would like to know a little bit about the way you use 
the Library of Congress: 



Q9. How often do you come to the Library of Congress (LC) ? 
(Circle the number) 



1 TJHXS IS MY FIRST TIME 

•37 2 OCCASIONALLY 

3 SEVERAL TIMES A MONTH 

4 SEVERAL TIMES A WEEK 



QIO. At what time of day do you usually come to LC? (Circle the number) 



\ ^ 1 WEEKDAYS EARLY MORNING 

\ TrZ* 2 WEEKDAYS ~ MID-DAY 

\ 3 WEEKDAYS ~ LATE AFTERNOON 

4 WEEKDAYS ~ EVENING, 

SL7 5 WEEKENDS 



■\ 

V 



Qll. Do you live in the Washington metropolitan area or have you come from 

9Z 



\^ out-of-town? (Circle the number) 



.g .1 LIVE IN THE WASHINGTON METROPOLITAN AREA 
2^ 2 FROM OUT-OF-TOWN, AND MADE A SPECIAL TRIP TO USE LC 

3 FROM OUT-OF-TOWN, BUT DID NOT MAKE A SPECIAL TRIP TO USE LC 



Q12. Is your use of LC related to — (Circle the number) 



8 
H 
// 

H 



1 UNDERGRADUATE OR VOCATIONAL EDUCATION 

2 POST-GRADUATE OR PROFESSIONAL EDUCATION 

3 DUTIES AS A MEMBER OF AN ACADEMIC FACULTY 

4 CONGRESSIONAL STAFF WORK 

5 EMPLOYMENT IN A FEDERAL GOVERNMENT AGENCY (NON-CONGRESSIONAL) 

6 LC STAFF WORK 

7 WORK AS A PRIVATE RESEARCHER OR AUTHOR 

'5 8 OTHER PROFESSIONAL OR WORK-RELATED RESEARCH 

\/3 9 PERSONAL, NON-WORK RESEARCH 



Q13. In which subject areas are you working today' 



4 



Q14. Are you primarily interested in materials published before or after 1969? 
(Circle the number) 

'J 1 BEFORE 1969 

2 AFTER 1969 
(oO 3 BOTH 

Q15. How did you first hear about our computer system (SCORPIO)? (Circle the 
number) 

1 SAW IT IN THE LIBRARY OF CONGRESS (LC) 
' 2 WAS REFERRED BY A LIBRARIAN AT LC 

•32. 3 FROM A FRIEND, COLLEAGUE, EMPLOYER, OR PROFESSOR 

^ 4 SAW IT MENTIONED IN A PUBLICATION (Where? 



OTHER; 



Q16. Have you ever used another computer information retrieval system, such as 
MEDLINE, LEXIS, ERIC, NTIS, and others? (Circle the number) 

^ 1 NO 

33 2 YES 

Q17. How long have you been using SCORPIO? (Circle the number) 

^3 1 JUST STARTED TODAY 

2 LESS THAN ONE MONTH 

3 1 TO 4 MONTHS 

3t 4 MORE THAN 4 MONTHS (NOT NECESSARILY CONTINUOUSLY) 

Q18. Where do you usually prefer to use terminals? (Circle the number) 

X.? 1 COMPUTER CATALOG CENTER (REAR OF CARD CATALOG) 

''j' 2 MAIN READING ROOM, OUTSIDE ALCOVES 

V 3 MAIN READING ROOM, ON DECK 33 (THROUGH ALCOVE 6) 
7 4 THOMAS JEFFERSON READING ROOM 

V 5 SCIENCE READING ROOM 

/ 6 CONGRESSIONAL: READING ROOM, REFERENCE CENTERS, OR OFFICES 

7 WHEREVER CONVENIENT FOR MY WORK 

8 WHEREVER THERE IS A PRINTER AVAILABLE 

2. 9 OTHER: 
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Q19. Where in the library would you like to see more terminals? (Circle all 
that apply) 

IS' 1 DON'T NEED MORE TERMINALS 

^6 2 NEED MORE, BUT DOESN'T MATTER WHERE 

2.6 3 MAIN READING ROOM 

7 4 THOMAS JEFFERSON READING ROOM 

5 NEWSPAPER AND CURRENT PERIODICAL READING ROOM 

7 6 STACKS; WHERE? 

'3 7 OTHER: 



Now, we would like to ask you about your experiences in learning to use 
the computer system (SCORPIO): 



Q20. How did you first learn to use SCORPIO? (Circle the number) 



65 

9 

33 

V 



1 FROM A LIBRARIAN AT THE COMPUTER CATALOG CENTER (AT THE REAR 

OF THE CARD CATALOG) 

2 FROM A LIBRARIAN IN ANOTHER PART OF LC (WHERE? 

3 FROM A FRIEND OR ANOTHER LIBRARY USER 

4 FROM THE FLIP-CHART BESIDE THE TERMINAL 

5 FROM THE BRIEF CARDS OR SHEETS ON THE TERMINAL 

6 FROM IN-HOUSE TRAINING FOR LC OR CONGRESSIONAL STAFF; SPECIFI- 

CALLY, 

7 OTHER: 
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Q21. Was it easy or hard to learn to use SCORPIO? (Circle the number) 



7 

lo 



1 HARD 

2 NEITHER HARD NOR EASY 

3 EASY 



Q22. Given what you now know about SCORPIO, and the use you make of it, 

could you benefit from additional training or written material? 
(circle the number) 



/5 



1 NO 

2 YES 



Q23. Consider the following aspects of learning to use SCORPIO. Was it easy 
or hard to learn how to do each? 

Was it easy or hard to learn this? 
( Circ le your answer) 

1. decide which command to use 79 EASY 33 MEDIUM HARD 

2. remember the order of the commands 67 EASY ^3 MEDIUM ^ HARD 

3. get the form of the command right hZ EASY ^tf MEDIUM ^ HARD 

4. specifying the subject heading correctly ... 66 EASY 36 MEDIUM /5 HARD 

5. inserting the correct spacing ^ EASY 2.6 MEDIUM 7 HARD 

6. punctuating the commands and headings EASY 30 MEDIUM 5 HARD 

7. understanding the computer's messages 6/ EASY ^/MEDIUM /V HARD 

8. understanding the printed instructions 62. EASY V3 MEDIUM HARD 

9. figuring out what to do when you have a problem 2Ll EASY V6 MEDIUM SO HARD 



Q24. Would the following things have made it easier for you to use SCORPIO? 

Would this have helped you? 
(Circle your answer) 

1. more assistance from Library staff 35 NO 35 YES MAYBE 

2. more complete instruc tions displayed 
by SCORPIO 51/ NO 70 YES 26 MAYBE 

3. group instruction in the use of SCORPIO 7/ NO i6 YES 25 MAYBE 

4. individual instruction by appointment NO 3^ YES 3 Z MAYBE 

5. computer-assisted (on-line) instruction i3 NO 79 2L3 MAYBE 

6. more detailed manuals by the terminals £V NO 5<y YES 30 MAYBE 

7. detailed instructions you could take 
away with you NO 75 YES 22 MAYBE 

8. a movie or slide-show on how to use SCORPIO .. NO 3? YES 32 MAYBE 
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Q25. Do the following factors make it easy or hard for you to physically use 

the terminal? , ^^^^ 

(Factor makes it : I 
(circle your answer) I 

1. the layout of the keys and control buttons .. -f/ HARD 6© EASY 52. NO EFFECT 

2. controlling the brightness of the screen 2L HARD 52. EASY <cl NO EFFECT 

3. the size of the letters on the screen 3 HARD 5i» EASY 5fc NO EFFECT 

4. the procedure for operating the printer 9 HARD ^9 EASY NO EFFECT 

5. the procedure for setting the margins on 

the printer (SHARD 26» EASY 55 NO EFFECT 

6. understanding the function of some of 

the control keys and switches V6 HARD Z4. EASY 31 NO EFFECT 

,7. other: HARD EASY NO EFFECT 



Q26. Would it help you to be able to reserve the facilities for the 

following services? . 

I Would you reserve for: f 

I (circle your answer) [ 

1. instruction in SCORPIO or other automated systems V7 NO 5Z YES 

2. use of a terminal 5l NO 52 YES 

3. use of a printer 56 YES 

4. discussing your search needs with a librarian who 

would then perform the search for you (not 

necessarily right away) toO NO ^5 YES 



Q27. If we were unable to provide the following services free of charge, 
would you be willing to pay a reasonable price for them? 

[Would you pay for: 
(Circle your answer) 

1. written instruction manuals to take with you 52. NO 55 YES 

2. having searches performed and printed out by a 

librarian 50 NO ^' YES 

3. printing at your terminal ^. */2. NO 6,*? YES 

4. having long lists of citations printed "off-line," 

that is, not during your search at the terminal, 
but at the central computer facility and to be 

picked up later NO 7/ YES x 

\ 
\ 

\ 



3^. 



\ 



These last questions will discuss your approaches to searching on SCORPIO: 



Q28. For what general purpose are you using SCORPIO today? (Circle all 
that apply) \ 

31 1 TO PREPARE AN EJCEENSIVE BIBLIOGRAPHY 

3*^ 2 TO SELECT A FEW GOOD ITEMS 

65 3 TO SCAN THE AVAILABLE LITERATURE OR FACTUAL INFORMATION 

l9 4, TO CHECK SPECIFIC FACTUAL INFORMATION (LEGISLATIVE OR ORGANIZATIONAL) 

/(» '5 OTHER: \ 

^ ■ \ 

Q29. Which of the following types of 'information do you expect to obtain from 

SCORPIO today? , , , , 

I Expect to find this: I 

1 (Circle your answer) | 

1. what LC has by a particular author *i5 NO H^S YES 

2. what books LC has on a particular subject /2. NO YES 

3. periodical articles in current events areas H8 NO 34> YES 

4. an author's name or other name 53- NO ZO YES 

5. specific titles (already knowing the authors) '/S NO 3fc YES 

6. call numbers for specific works (when you already 

know the author or title) ^5 NO *f/ YES 

7. legislative information S8 NO ^5 YES 

8. names of organizations NO to YES 

Q30. In your last search on SCORPIO, under which types of headings did you 
mainly look? (Circle all that apply) 

Z8 1 PERSONAL NAMES 

2- ORGANIZATION OR AGENCY NAMES 

3.V 3 TITLES 

I . 4 BILL NUMBERS , 

// • 5 LC CARD NUMBERS 

9$ '\ 6 SUBJECTS 

\ If you searched by subject: Which system did you use? 

\^ (Circle all that apply) 

1 LC SUBJECT HEADINGS LIST (LARGE RED VOLUMES) 

5 2 LEGISLATIVE INDEXING VOCABULARY (LIV: IN LOOSELEAF 
BINDER, USED FOR BIBL OR CG FILES) 

JO 3 LC CLASSIFICATION NUMBER 

■ "2. 4 THE RETRIEVE COMMAND 

^2. 5 BROWSE RANDOMLY UNDER A WORD YOU KNOW 

\ 

\ \ 
\ 

ERic; , ^'^ 

. \ \ . \ 
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Q31. In general, is the order in which citations are displayed by SCORPIO 
(roughly chronological) satisfactory for your searching? 
(Circle the number) 

2 YES 



Q32. For each of the following choices, indicate how preferable it would be 
to the currently used order of citations. (Circle your answer) 



How would It compare to 
chronological order? 



1. reverse chronological order (most ' 

recent entry first) /? WORSE Hi SAME 39 BETTER 

2. alphabetical by title '7 WORSE 57 SAME BETTER 

3. alphabetical by author / 2- WORSE 53, SAME 2-7 BETTER 

4. other . WORSE 5 SAME 2. BETTER 

Q33. When you don't find information through SCORPIO, which of the 
following steps do you take? (Circle all that apply) 

6Z 1 TRY A DIFFERENT SEARCH TERM ON SCORPIO 

a-5 2 TRY A DIFFERENT DATA BASE (FILE) ON SCORPIO 

.35 3 ASK COMPUTER CATALOG CENTER LIBRARIAN FOR ASSISTANCE 

4 ASK REFERENCE LIBRARIAN IN READING ROOM ABOUT OTHER SOURCES 

5f 5 GO TO CARD CATALOG 

3/ 6 GO TO PRINTED INDEXES AND BIBLIOGRAPHIES 

V 7 GIVE UP COMPLETELY 

7 8 OTHER: 



Q34. Did you use the card catalog in addition to SCORPIO today? (Circle the 
number) 

SI 1 NO (If no, please skip to question #34) 
5^ 2 YES 

(If yes:) What did you look under? (Circle all that apply) 

29 1 AUTHOR (PERSONS OR ORGANIZATIONS) 

2.V 2 TITLE (OF BOOKS OR PERIODICALS) 

37 3 SUBJECT \ 



ERIC 
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Q35. For the following types of searches or problems, is SCORPIO or the card 

catalog easier to search? If you have another example that works noticeably 

better in one system than the other, you may add it at the end. 

I For this search, which system is easier? 

I (Circle your answer) 

1. searching for books (within last 

ten years) by subject 92. SCORPIO 5SAME 7 CARDS 5 DON'T KNOW 

2. searching by author SCORPIO /©SAME 1^ CARDS S DON'T KNOW 

3. searching by title (efl SCORPIO /O SAME ^ZCARDS 6 DON'T KNOW 

4. searching by gov't agency names ... 38 SCORPIO 2 SAME ^ CARDS 37 DON'T KNOW 

5. searching for items published at 

a certain date '39 SCORPIO Z SAME 8 CARDS 3<? DON'T KNOW 

6. searching for items published in 

a certain language ^9 SCORPIO 3 SAME /V CARDS ''^ DON'T KNOW 

7. finding cross-references HO SCORPIO 5 SAME /fcCARDS DON'T KNOW 

8. understanding the filing order 2.8 SCORPIO /O SAME / 7 CARDS 29 DON'T KNOW 

9. understanding the difference between 

author/title/subject entries 

(on cards or in SCORPIO index) 3/ SCORPIO 23 SAME iZcARDS /7 DON'T KNOW 

10. other:^ 

•••• 2. SCORPIO SAME CARDS 2- DON'T KNOW 



Q36. Could SCORPIO completely replace the card catalog for your purposes 
today? (Circle the number) 

5V 1 NO 

S8 2 YES (If yes, please skip to question #38) 



Q37. If no, why can't SCORPIO replace the card catalog for your purposes 
today? (Circle all that apply) 



zs 

/2. 
37 

7 
H 



IT LACKS PERIODICAL TITLES 

IT LACKS MATERIALS IN SPECIAL FORMATS (MUSIC, MICROFORMS, MAPS, ETC.) 

IT LACKS MATERIALS IN CERTAIN LANGUAGES (CHINESE, RUSSIAN, ETC.) 

IT DOES NOT INCLUDE WORKS CATALOGED BEFORE 1968 

IT CANNOT BE SEARCHED BY THE NAME OF A SERIES 

THE COMPUTER IS "DOWN" (NOT WORKING) TOO OFTEN 

THERE is TOO OFTEN A WAIT FOR TERMINALS 

IT IS TOO COMPLICATED TO LEARN TO USE QUICKLY 

OTHER: \ 



ERIC 
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038. The Library of Congress would appreciate any other comments, suggestions, 
or criticisms that you have related to the SCORPIO system or other public 



V 

services : 



ERIC 



